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This listing of claims will replace all prior versions, and listing, of claims 
in the application; 

Listing of Claims 

Claim 1 (currently canceled) 

Claim 2 (currently amended): A method as rooitod in claim 1, furth e r 
comprising: / 

initiating a search for images based on at least one query keyword in a 

query: / 

identifying, durii/g the search, first images having associated keywords that 
match the query keyword and second images that contain low-level features 
similar to those of the farst images; and 

ranking the Grit and second images. 

Claim 3 (crarently amended): A method as recited in claim 4-23 further 
comprising preseimng the first and second images. 
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Claim 4 (currently amended): A meffiod as recited in olaim 1, furtfagr 
comprising: 

initiatiDg a search for images based^ on at least one oucrv keyword in a 

identifving> during the search, W images having associated keywords that 
match the Querv keyword and secon^ images that con tain low-levei features 
similar to those of the first images: 

presenting the first and second images to a user; and 

monitoring feedback from jihe user as to which of the first and second 
images are relevant to the query. 



Claim 5 (currently am^ded): A method as rooit a d in claim 1, fiirfhor 
comprising: 

initiating a search fo/ images based on at least one query keyword in a 

identifying^ during me search, first images having associated keywords that 
match the querv kevwoffd and second images that contain low-level features 
similar to those of the first images: 

presenting the first and second images to a user, 

receiving feedback from the user as to whether the first and second images 
are relevant to the query; and 

learning how the first and second images are identified based on the 
feedback fix>m the user^ 



mm46J^} C.^it31-C^6Mm^iG^-604V5MV2vJJoc 
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Claim 6 (cuirently amended): A method as recited in claim 4-2, wherein the 
monitoring compris!^_fa F her oomprising: 



presenting the first 
receiving feedback: 
are relevant to the queryt 



refining the seanh to identify additional images that contain low-level 



features similar to those 
query. 



I >f the images indicated by the user as being relevant to the 



Claim 7 (currentl]^ 



monitoring comprises fe rth e r oomprising: 



Claim 8 (origina 



and second images to a user, 

from the user as to whether the first and second images 
aad -, further comprising: 



amended): A method as recited in claim +2, wherein the 



presenting the fin t and second images to a user; 

receiving feedba<ik from the user as to whether the first and second images 
are relevant to the queiy -aad -, further comprising: 

assigning a large weight to an association between the query keyword and 
the images deemed relevant by the user. 



: A method as recited in claim 7, further comprising 



grouping the low*level features of the images deemed relevant by the user. 

\ 
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Claim 9 (curr mtly amended): A method as recited in claim -t2, wherein the 
monitoring comprise s farth e r oomprioing: 



presenting the 



first and second images to a user; 



receiving feec back from the user as to whether the first and second images 
are relevant to the ervg-md -. further comprising: 

assigning a small weight to an association between the query keyword and 
the example image. 



Claim 10 0 
identifying 
example image. 



0]1 



iginal): A method as recited in claim 9, further comprising 
additional images with low-level features similar to those of the 



Claim 11 
computer-executab 
method as recited ii l 



(currently amended): A computer readable medium having 
e instmctions that, when executed on a processor, perform the 
claim 4-2. 



images are relevant^ 
conducting s 
relevance feedback 



Claim 12 (or ginal): A method comprising: 

permitting er try of both keyword-based queries and content-based queries; 
finding images using both semantic-based image retrieval and low-level 
feature-based image retrieval; 

presenting tqe images to a user so that the user can indicate whether the 
and 

OTiantic-based relevance feedback and low-level feature-based 
in an integrated fashion. 
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Claim IB (original): A method as recited in claim 12, further comprising 
ranking the images. 

Claim 14 (original): A method as recited in claim 12, further comprising 
using images indioated as being relevant to find additional images. 

Claim 15 (original): A computer readable medium having computer- 
executable instmctioVis that, when executed on a processor, perform the method as 
recited in claim 12. \ 

Claims 16-19 (cubently canceled) 

Claim 20 (origiiial):\ A method comprising: 

presenting a result set of images that are returned from an image retrieval 
search of a query having at least one keyword; 

monitoring feedback from a user as to whether the images in the result set 
are relevant to the query, \ 

in an event that the user relects at least one image as being relevant to the 
query, associating the keyword in me query with the selected image to form a first 
keyword-image association and assigning a comparatively large weight to the first 
keyword-image association; and \ 

in an event that the user identifies an example image for refinement of the 
search, associating the keyword in the\query with the example image to form a 
second keyword-image association and assigning a comparatively small weight to 
the second keyword-image association. \ 
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Clattn 21 (original): A method as recited in claim 20, further comprising 
conducting ooth content-based image retrieval and semantic-based image retrieval. 

Claim 22 (original): A method as recited in claim 20, further comprising 
presenting the tesult set of images in a user interface, the user interface facilitating 
the user feedback by allowing the user to indicate which images are more relevant 
and which image^are less relevant. 

Claim 23 (original): A computer readable medium having computer- 
executable instructions^that, when executed on a processor, perform the method as 
recited in claim 20. 

Claim 24 (previously amended): A method comprising: 

computing, for each Category, a representative feature vectors of a set of 
existing images within the category; 

determining a set of repWsentative keywords that are associated with the 
existing images in each category, 

comparing, for each new iniage, the low-level feature vectors of the new 
image to the representative feature vwtors of the existing images in each category 
to identify a closest matching category; md 

labeling the new image with the s^t of representative keywords associated 
with the closest matching category. 



25 
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Claim 25 (currently amended): A method as redted in claim 24, further 
comprising using user feedback to selectively add and/or remove keywords from 
the new image. / 

Claim 26 (original): A method as recited in claim 24, further con^rising: 

placing the labeled new images into a holding cjftegory; 

evaluating the labeled new images in the hcflding category to determine if 
any of the keywords associated with the /labeled new image match the 
representative keywords from each category; /and 

assigning the labeled new image /to the category that best matches the 
keywords associated with the labeled new image. 

Claim 27 (cxirrently canceled): 

Claim 28 (currently amended): An image retrieval system as rooitod in 
e kiim 27. comprising: / 

a query handler to >nandle both keyword-based queries having one or more 
search keywords and content-based queries having one or more low-level features 
of an image: and / 

a feature and semantic matcher to identif / at least one of (i) first images 
having kcywords/that match the search keywords from a keyword-based query, and 
(2) second images having low-level features similar to the low-level features of a 
content-based query, w herein the feature and semantic matcher ranks the images. 
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Claim 29 (currently amended): An image retrieval syst^ as recited in 
claim 2^ wherein the query handler comprises a natural l^^ge parser. 



Claim 30 (currently amended): An imajge retrieval system as recited in 
claim 2^8, wherein the query handler compm 
a parser to parse text-based quexii^; and 
a concept hierarchy to defin^arious categories of images. 
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Claim 31 (cmrentiy amended): An image retrieval system as recited in 
claim 278, further conr^sing a user interface to present the images identiified by 
the feature and sei3fmntic matcher. 
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Claim 32 (currently amended): An image retrieval system p rooitod in 
oldm 27 . comprising: 

a query handler to handle both kevword^bascd q ueries haVing one or more 
search keywords and content-based queries havin g one or mofe low-level features 
of an image; 

a feature and semantic matcher to identify at le£st o ne of (I) first images 
having keywords that match the search keywords frcafa a kewyord-based query, and 
(2) second images havinp low-level features simflar to the low-le vel features of a 
content-based query; 

a user interface to present the imag^ identified by the feature and semantic 
matcher to a user, the user interface jfllowing the user to indicate whether the 
images are relevant to the query; and/ 

a feedback analyzer to tptoi the image retrieval system based on user 
feedback as to relevancy. 

Claim 33 (cuirendy amended): An image retrieval sj^tem as recited in 
claim 298, finder comprising: 

a user interfaoe to present the images identified by the feature and semantic 
matcher to a use/ the user interface allowing the user to identify an example 
image; and 

the fejfture and semantic matcher being configured to identify additional 
images thaycontain low-level features similar to those of the example image. 
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Claim 34 (currently amended): An image retrieval system as raited in 
claim 278, further comprising: / 

a user interface to present the images identified by the feature^nd semantic 
matcher to a user, the user interface allowing the user to identify^hich images are 
relevant to a particular search query; and / 

a feedback analyzer to assign a large weight to an Association between the 
search keywords and the images identified as relevant by the user. 

Claim 35 (original): An image retrieval/system as recited in claim 34, 
wherein the feedback analyzer groups the ^w-level features of the images 
identified as relevant by the user. / 

Claim 36 (currently amended)/ An image retrieval system as recited in 
claim 2?8, further comprising: / 

a user interface to presentydie images identified by the feature and semantic 
matcher to a user, the user inte^ace allowing the user to identify an example image 
as being less relevant or irrdevant to the query; and 

a feedback analyzer to assign a small weight to an association between the 
search keywords and the example image. 

Claim 37 ^original): An image retrieval system as recited in claim 36, 
wherein the feature and semantic matcher identifies additional images with low- 
level featuresysimilar to those of the example image. 
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Claim 38 (original): A datab^»^ structure stored on one or more computer- 
readable media comprisi 
multiple image fi^ 
multiple keywc 

a semantic/network to associate the keywords with the image files, the 
semantic netjrork defining individual keyword-image links that associate a 
particular/lfeyword with a particular image file, each key\5(ord-image hnk having a 
weighnndicative of how relevant the particular keyword is to tjie particular image 



10 

/ 
n 

12 

13 
14 
15 
16 
17 
18 
19 

20 

21 

22 

23 

24 

25 



Claim 39 (currently amended): A computer^adable medium having 
computer-executable instructions that, when executed, directs a computer to: 

find images using both semantic-bas^ image retrieval and low-level 
feature-based image retrieval; 

present the images to a user so tl^ the user can indicate whether the images 
are relevant; and 

concurrently conduct s^antic-based relevance feedback and low-level 
feature-based relevance feedback. 



Claim 40 (original): A program as recited in claim 39, further comprising 
computer-executeDle instructions that, when executed, direct a computer to tank 



the images. 



/ 
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Claim 41 (original): An informatioxKretrieval program, embodied on the 
computer-readable medium, comprising the computer-executable instructions of 
claim 39. 




Claim 42 (cunently added): A computer readable medium having 
computer-execij^le instructions that, when executed on a processor, perform the 
method as i^ited in claim 4. 
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